Distilling the Knowledge in a Neural Network > 作为model compression系列中比较具有代表性的paper，选取这一篇做为开头。其实在这篇文章之前也有 ... ... <看更多>

This is an implementation of a part of the paper "Distilling the Knowledge in a Neural Network" (https://arxiv.org/abs/1503.02531). Teacher network has two ... ... <看更多>

Nov 29, 2017 - A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and ... ... <看更多>

There is a famous paper "distilling the knowledge in a neural network" from Hinton about training a small NN to represent a large deep NN. ... <看更多>